Addressing Confounding in Predictive Models with an Application to Neuroimaging

Understanding structural changes in the brain that are caused by a particular disease is a major goal of neuroimaging research. Multivariate pattern analysis (MVPA) comprises a collection of tools that can be used to understand complex disease effects across the brain. We discuss several important issues that must be considered when analyzing data from neuroimaging studies using MVPA. In particular, we focus on the consequences of confounding by non-imaging variables such as age and sex on the results of MVPA. After reviewing current practice to address confounding in neuroimaging studies, we propose an alternative approach based on inverse probability weighting. Although the proposed method is motivated by neuroimaging applications, it is broadly applicable to many problems in machine learning and predictive modeling. We demonstrate the advantages of our approach on simulated and real data examples

Control-Group Feature Normalization for Multivariate Pattern Analysis Using the Support Vector Machine

Normalization of feature vector values is a common practice in machine learning. Generally, each feature value is standardized to the unit hypercube or by normalizing to zero mean and unit variance. Classification decisions based on support vector machines (SVMs) or by other methods are sensitive to the specific normalization used on the features. In the context of multivariate pattern analysis using neuroimaging data, standardization effectively up- and down-weights features based on their individual variability. Since the standard approach uses the entire data set to guide the normalization it utilizes the total variability of these features. This total variation is inevitably dependent on the amount of marginal separation between groups. Thus, such a normalization may attenuate the separability of the data in high dimensional space. In this work we propose an alternate approach that uses an estimate of the control-group standard deviation to normalize features before training. We also show that control-based normalization provides better interpretation with respect to the estimated multivariate disease pattern and improves the classifier performance in many cases

Neuroanatomical pattern classification in a population-based sample of first-episode schizophrenia

AbstractRecent neuroanatomical pattern classification studies have attempted to individually classify cases with psychotic disorders using morphometric MRI data in an automated fashion. However, this approach has not been tested in population-based samples, in which variable patterns of comorbidity and disease course are typically found. We aimed to evaluate the diagnostic accuracy (DA) of the above technique to discriminate between incident cases of first-episode schizophrenia identified in a circumscribed geographical region over a limited period of time, in comparison with next-door healthy controls. Sixty-two cases of first-episode schizophrenia or schizophreniform disorder and 62 age, gender and educationally-matched controls underwent 1.5T MRI scanning at baseline, and were naturalistically followed-up over 1year. T1-weighted images were used to train a high-dimensional multivariate classifier, and to generate both spatial maps of the discriminative morphological patterns between groups and ROC curves. The spatial map discriminating first-episode schizophrenia patients from healthy controls revealed a complex pattern of regional volumetric abnormalities in the former group, affecting fronto-temporal-occipital gray and white matter regions bilaterally, including the inferior fronto-occipital fasciculus, as well as the third and lateral ventricles. However, an overall modest DA (73.4%) was observed for the individual discrimination between first-episode schizophrenia patients and controls, and the classifier failed to predict 1-year prognosis (remitting versus non-remitting course) of first-episode schizophrenia (DA=58.3%). In conclusion, using a “real world” sample recruited with epidemiological methods, the application of a neuroanatomical pattern classifier afforded only modest DA to classify first-episode schizophrenia subjects and next-door healthy controls, and poor discriminative power to predict the 1-year prognosis of first-episode schizophrenia

Diagnostic potential of structural neuroimaging for depression from a multi-ethnic community sample

Background At present, we do not have any biological tests which can contribute towards a diagnosis of depression. Neuroimaging measures have shown some potential as biomarkers for diagnosis. However, participants have generally been from the same ethnic background while the applicability of a biomarker would require replication in individuals of diverse ethnicities. Aims We sought to examine the diagnostic potential of the structural neuroanatomy of depression in a sample of a wide ethnic diversity. Method Structural magnetic resonance imaging (MRI) scans were obtained from 23 patients with major depressive disorder in an acute depressive episode (mean age: 39.8 years) and 20 matched healthy volunteers (mean age: 38.8 years). Participants were of Asian, African and Caucasian ethnicity recruited from the general community. Results Structural neuroanatomy combining white and grey matter distinguished patients from controls at the highest accuracy of 81% with the most stable pattern being at around 70%. A widespread network encompassing frontal, parietal, occipital and cerebellar regions contributed towards diagnostic classification. Conclusions These findings provide an important step in the development of potential neuroimaging-based tools for diagnosis as they demonstrate that the identification of depression is feasible within a multi-ethnic group from the community. Declaration of interests C.H.Y.F. has held recent research grants from Eli Lilly and Company and GlaxoSmithKline. L.M. is a former employee and stockholder of Eli Lilly and Company

Brain extraction on MRI scans in presence of diffuse glioma: Multi-institutional performance evaluation of deep learning methods and robust modality-agnostic training

Brain extraction, or skull-stripping, is an essential pre-processing step in neuro-imaging that has a direct impact on the quality of all subsequent processing and analyses steps. It is also a key requirement in multi-institutional collaborations to comply with privacy-preserving regulations. Existing automated methods, including Deep Learning (DL) based methods that have obtained state-of-the-art results in recent years, have primarily targeted brain extraction without considering pathologically-affected brains. Accordingly, they perform sub-optimally when applied on magnetic resonance imaging (MRI) brain scans with apparent pathologies such as brain tumors. Furthermore, existing methods focus on using only T1-weighted MRI scans, even though multi-parametric MRI (mpMRI) scans are routinely acquired for patients with suspected brain tumors. In this study, we present a comprehensive performance evaluation of recent deep learning architectures for brain extraction, training models on mpMRI scans of pathologically-affected brains, with a particular focus on seeking a practically-applicable, low computational footprint approach, generalizable across multiple institutions, further facilitating collaborations. We identified a large retrospective multi-institutional dataset of n=3340 mpMRI brain tumor scans, with manually-inspected and approved gold-standard segmentations, acquired during standard clinical practice under varying acquisition protocols, both from private institutional data and public (TCIA) collections. To facilitate optimal utilization of rich mpMRI data, we further introduce and evaluate a novel ‘‘modality-agnostic training’’ technique that can be applied using any available modality, without need for model retraining. Our results indicate that the modality-agnostic approach1 obtains accurate results, providing a generic and practical tool for brain extraction on scans with brain tumors

Design and methods of the NiCK study: neurocognitive assessment and magnetic resonance imaging analysis of children and young adults with chronic kidney disease

Abstract Background Chronic kidney disease is strongly linked to neurocognitive deficits in adults and children, but the pathophysiologic processes leading to these deficits remain poorly understood. The NiCK study (Neurocognitive Assessment and Magnetic Resonance Imaging Analysis of Children and Young Adults with Chronic Kidney Disease) seeks to address critical gaps in our understanding of the biological basis for neurologic abnormalities in chronic kidney disease. In this report, we describe the objectives, design, and methods of the NiCK study. Design/methods The NiCK Study is a cross-sectional cohort study in which neurocognitive and neuroimaging phenotyping is performed in children and young adults, aged 8 to 25 years, with chronic kidney disease compared to healthy controls. Assessments include (1) comprehensive neurocognitive testing (using traditional and computerized methods); (2) detailed clinical phenotyping; and (3) multimodal magnetic resonance imaging (MRI) to assess brain structure (using T1-weighted MRI, T2-weighted MRI, and diffusion tensor imaging), functional connectivity (using functional MRI), and blood flow (using arterial spin labeled MRI). Primary analyses will examine group differences in neurocognitive testing and neuroimaging between subjects with chronic kidney disease and healthy controls. Mechanisms responsible for neurocognitive dysfunction resulting from kidney disease will be explored by examining associations between neurocognitive testing and regional changes in brain structure, functional connectivity, or blood flow. In addition, the neurologic impact of kidney disease comorbidities such as anemia and hypertension will be explored. We highlight aspects of our analytical approach that illustrate the challenges and opportunities posed by data of this scope. Discussion The NiCK study provides a unique opportunity to address key questions about the biological basis of neurocognitive deficits in chronic kidney disease. Understanding these mechanisms could have great public health impact by guiding screening strategies, delivery of health information, and targeted treatment strategies for chronic kidney disease and its related comorbidities